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This listing of claims will replace all prior versions, and listings, of claims in the 
application: 

Listing of Claims: 

Claim 1-12 (Canceled). 

Claim 1 3 (Currently Amended): A method for augmented reality guided 
instrument positioning, comprising the steps of: 

rendering at least one graphics path guide for indicating a path for an 
instrument to follow to a target; 

constructing and rendering at least one graphical axis marker; 

providing the rendered at least one graphics path guide and graphical axis 
marker to a video and graphics overlay module: 

displaying the rendered at least one graphics path guide and graphical 
axis marker on a stereo display; 

identifying at least one graphical axis marker on the instrument that marks 
an axis of the instrument, the axis disposed from a front portion to a back portion 



o 

of the instrument, the front portion corresponding to the point on the target; and Q 
aligning the at least one identified graphical axis marker with respect to UJ 
the at least one graphics guide to align the instrument to the path by £0 
repositioning the instrument with respect to the graphics guide using the stereo !fj 
display so that the instrument moves toward_alignmentjvith the target. $~ 

i— 

Claim 14 (Canceled). fa 

Lii 



Claim 15 (Previously Presented): The method according to claim 13, further 
comprising the step of tracking the instrument to register the at least one 
identified graphical axis marker with respect to the axis of the instrument 
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Claim 16 (Currently Amended): The method according to claim 13, further 
comprising the step of effectively constructing and rendering a graphical axis 
marker by s electing an existing feature of the instrument to be a graphical axis 
marker. 



Claim 17 (Previously Presented): The method according to claim 13. further 
comprising the step of designing the instrument to include at least one physical 
axis marker. 



Claim 18 (Previously Presented): The method according to claim 13, further 
comprising the step of adding at least one physical axis marker to a structure of 
the instrument. 



Claim 19 (Previously Presented): The method according to claim 13, wherein the >~ 
at least one identified graphical axis marker is an elongated member. q 

O 

Claim 20 (Previously Presented): The method according to claim 13, wherein the |Jj 
at least one identified graphical axis marker has a circular shape, and is centered CD 
on the axis of the instrument. 



Claim 21 (Previously Presented): The method according to claim 13, wherein the 



1 



at least one identified graphical axis marker is a cross comprised of an CO 
intersection of at least two lines, the intersection being centered on the axis of ^ 
the instrument. 



Claim 22 (Previously Presented): The method according to claim 13, wherein the 
at least one identified graphicalaxis marker comprises at least two axis markers 
for controlling alignment of the instrument along a line of sight. 
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Claim 23 (Currently Amended): A method for virtual reality guided instrument 
positioning, comprising the steps of: 

defining a point on an actual target and an actual path to reach the point 
on the actual target; 

tracking a pose of an actual instrument with respect to a pose of the actual 

target; 

rendering a graphical representation of the actual instrument and the 
actual target point to obtain a virtual instrument and a virtual target point, 
respectively, the graphical representation being rendered with respect to a virtual 
viewpoint from which a virtual line of sight to the virtual target point coincides with 
a virtual path for the virtual instrument to follow during a positioning of the actual 
instrument to the point on the actual target, the virtual path corresponding to the 
actual path, the virtual instrument comprising a 3D structure for line of sight 
alignment, the 3D structure comprising a plurality of markers centered on and 
distributed along an axis of the virtual instrument; 

providing the rendered virtual instrument and virtual target point to a video 
and graphics overlay. module: >* 
displaying the rendered_vir_tual instrument and virtual target point on a O 



stereo display; and 

aligning the virtual instrument along the virtual line of sight to the virtual target 
point to align the actual instrument along the actual path bv repositioning the 
virtual instrument with respect to the virtual target point using the stereo display 
so thatjhe virtual instrument moves toward alignment with the target . 



c 

UJ 

CD 
< 




Claim 24 (Original): The method according to claim 23, further comprising the 
step of moving the actual instrument along the actual path towards the point on 
the actual target, subsequent to said aligning step. 
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Claim 25 (Original): The method of claim 23, wherein the virtual target point has 
a circular shape. 



Claim 26 (Original): The method of claim 25, wherein the circular shape is a ring. 
Claim 27-28 (Canceled). 

Claim 29 (Previously Presented): The method of claim 23, wherein said plurality 
of markers comprise at least two rings, centered on an axis of the virtual 
instrument. 



Claim 30 (Original): The method of claim 29, wherein the at least two rings have 
different diameters. 



Claim 31 (Currently Amended): A method for virtual reality guided instrument ^, 



a 
C 
c 



positioning, comprising the steps of: 

defining a point on an actual target and an actual path to reach the point 

on the actual target; 

£1 

tracking a pose of an actual instrument with respect to a pose of the actual < 

target; § 

rendering a graphical representation of the actual instrument and the ^ 

actual target point to obtain a virtual instrument and a virtual target point, ^ 

respectively, the graphical representation being rendered with respect to a virtual |£j 
viewpoint from which a virtual line of sight to the virtual target point coincides with 
a virtual path for the virtual instrument to follow during a positioning of the actual 
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instalment to the point on the actual target, the virtual path corresponding to the 
actual path; 

providing the rendered virtual instrument and virtual target point to a video 
and.qraphics overlay module; 

displaying the rendered virtual instrument and virtual target point on a 
stereo display; 

choosing an orientation of the graphical representation around the virtual 
line of sight according to a pose of a user with respect to the actual target; and 

aligning the virtual instrument along the virtual line of sight to the virtual 
target point to align the actual instrument along the actual path by repositioning 
the virtual instrument with respect to the virtual target point using the stereo 

display so that the virtual instrument moves toward alignment with the target . 



Claim 32 (Original): The method of claim 31 , further comprising the step of 
determining the orientation such that east, west, north, and south correspond to 
right, left, forward, and backward, respectively, for the pose of the user in which 
the user faces the actual target, said determining step based on a selection. 

o 
o 

Claim 33 (Original): The method of claim 31 , wherein the orientation is UJ 
dynamically adjusted according to a change of the pose of the user. CD 

I 

Claim 34 (Original): The method of claim 32, wherein the selection is dynamically ^ 
adjusted with respect to the pose of the user. 

Claim 35 (Currently Amended): A metfiod for virtual reality guided instrument 
positioning, comprising the steps of: 



CD 
UJ 

CD 



6 



PAGE 7/13 * RCVD AT 8116/2005 10:59:32 AM [Eastern Daylight Tie] ' SVR:USPTO-EFXRF-6/26 ' DNIS:2738300 * CSID:1-732-321-3030 » DURATION (mm-ss):02-44 



08-16-05; 10:05AM; 



; 1-732-321-3030 # 8/ 13 



Appl. No. 09/818,427 

Amdt dated August 16,2005 

Reply to Office Action of June 28, 2005 

defining a point on an actual target and an actual path to reach the point 
on the actual target; 

tracking a pose of an actual instrument with respect to a pose of the actual 

target; 

rendering a graphical representation of the actual instrument and the 
actual target point to obtain a virtual instrument and a virtual target point, 
respectively, the graphical representation being rendered with respect to a virtual 
viewpoint from which a virtual line of sight to the virtual target point coincides with 
a virtual path for the virtual instrument to follow during a positioning of the actual 
instrument to the point on the actual target, the virtual path corresponding to the 
actual path; 

providing the rendered virtual instrument and virtual target point to a video 
and qraphics overiay_mod_ule; 

displaying the rendered virtual instrument and virtual target point on a 
stereo display; 

rendering graphical information about a distance between the actual 
instrument and the point on the actual target, the graphical information about the 
distance being overlaid onto the graphical representation; and ^ 

aligning the virtual instrument along the virtual line of sight to the virtual O 
target point to align the actual instrument along the actual path bv repositioning 

the virtual instrument with respect to the virtual target point using the stereo gJ 

display so that the virtual instrument moves toward alignment with the target . <j 



PAGE 8113 * RCVD AT 8/16/2005 10:59:32 AM [Eastern Daylight frnie] ' SVR:USPTO-EFXRF-6/26 * DNIS:2738300 * CSID:1*732-321-3030* DURATION (mm-ss):0244 



Claim 37 (Currently Amended): A method for virtual reality guided instrument 
positioning, comprising the steps of: 



Claim 36 (Canceled). 
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defining a point on an actual target and an actual path to reach the point 
on the actual target; 

tracking a pose of an actual instrument with respect to a pose of the actual 

target; 

rendering a graphical representation of the actual instrument and the 
actual target point to obtain a virtual instrument and a virtual target point, 
respectively, the graphical representation being rendered with respect to a virtual 
viewpoint from which a virtual line of sight to the virtual target point coincides with 
a virtual path for the virtual instrument to follow during a positioning of the actual 
instrument to the point on the actual target, the virtual path corresponding to the 
actual path; 

providing the rendered virtual instrument and virtual target point to a video 
and graphics overlay module: 

displaying the rendered virtual instrument and virtual target point on a 
stereo display; and 

aligning the virtual instrument along the virtual line of sight to the virtual 

target point to align the actual instrument along the actual path wherein the 

virtual target point and the virtual instrument are designed such that information 

corresponding to the distance between the actual instrument and the point on the O 

actual target can be directly observed from an alignment of the virtual target point ^ 

and the virtual instrument b y_repositioning_the_virtual instrument with respect to „j 

CD 

the virtual target point using the stereo display so that the virtual instrument <^ 
moves toward alignment with the target .. ~j 



Claim 38 (Original): The method of claim 35, wherein said rendering step is 
performed according to a virtual camera with a wide angle lens. 
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Claim 39 (Previously Presented): The method of claim 35, wherein the virtual 
target point and the virtual instrument are each comprised of at least one ring 
centered on the target point respectively on the axis of the instrument, and a 
diameter of the at least one ring is dimensioned to achieve a pre-defined 
configuration together with the actual instrument when the actual instrument 
reaches the actual target. 



Claim 40 (Original): The method of claim 23, wherein the graphical 
representation from the virtual viewpoint is combined with another graphical 
representation from another virtual viewpoint looking at the virtual path from a 
side thereof. 



Claim 41 (Original): The method of claim 23, wherein said graphical 
representation from the virtual viewpoint is combined with an augmented reality 
view. 



o 
o 
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